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BACKGROUND TO THE INVENTION 

This invention relates to a non-blocking high capacity fine grain switch for use in a 
communications network, and to a communications network incorporating such a 
10 switch. The invention further relates to method of a controlling traffic in such a 
switch, and to a switch node incorporated in such a switch. The invention is 
particularly but not exclusively suitable for use in a telecommunications environment. 

Photonic switches, such as can be implemented by micro-electromechanical 
15 (MEMS) devices, are an example of high bandwidth cross-connects which 
performing coarse granularity switching. Such switches enable the entire signal 
carried along an optical fiber to be switched to another optical fiber. For example, a 
thousand port photonic cross-connect receiving signals along each port at 1 Tbit/s 
can switch a traffic stream having a bandwidth of 1000 Tbit/s. However, the 
20 switching granularity of 1 Tbit/s is particularly coarse and has limited applications. 
Such switches do not support the switching of smaller bandwidth, or fine granularity, 
traffic. 

The SONET (Synchronous Optical Network) standard defined by ANSI (American 
25 National Standards Institute) and the SDH (Synchronous Digital Hierarchy) standard 
defined by the ITU-T (International Telecommunications Union Telecommunications 
Standardization Sector) each specify a hierarchy of payload units. In SONET, the 
basic unit is an STS-1, offering a bandwidth of approximately 50 Mbit/s. In SDH, the 
basic unit is an AU-4, offering a bandwidth of approximately 150Mbit/s. 

30 

Within the SDH and SONET standards, smaller bandwidth data structures can be 
incorporated and/or multiplexed into larger bandwidth structures. For example, 
within SDH channels with smaller bandwidths can be provided by, for example, VC- 
12 (approximately 2Mbit/s) and VC-3 (approximately 50 Mbit/s). VC-12 and VC-3 
35 channels are known as lower order data structures or lower order containers. Lower 
order containers are carried within higher order data structures or higher order 
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containers such as VC-4. The VC-4's are then multiplexed to higher data rates. 
Similar data structure hierarchies exist within SONET. In both SONET and SDH 
environments therefore, the extraction and insertion of lower order data structures, 
or fine granularity traffic, to broader bandwidth traffic streams is known. 

The capacity of fine granularity switches for switching traffic is generally much less 
than the capacity of coarse granularity switches such as photonic cross-connects. 
For example, a fine grain granularity SONET/SDH cross-connect is the SDH 4/1 
cross-connect which has a switching granularity of one SDH VC-12. However, the 
size of the SDH 4/1 is limited and is unlikely to exceed 2000 STM-1 ports or a total 
bandwidth of 300 Gbit/s. Enhancing known fine granularity switches to have a 
capacity of 100's of Gbit/s generates bulky switches which can use up tens of racks 
of equipment. Fine granularity switches known in the art are unlikely to exceed 300 
Gbit/s. 

Simply combining several fine granularity switches together to form a larger capacity 
switch is not feasible as most such switches will be blocking. A combination of 
switches capable of providing both fine grain and coarse grain switching functions to 
form a large capacity switch such as Fig. 2 of the accompanying drawings does not 
provide a practical solution either as the switch formed can still be blocking in the 
manner described in more detail later. 

It is highly desirable, particularly in the telecommunications environment, to provide 
a switch having a capacity large enough to be able to switch large bandwidth traffic 
yet which has the ability to switch fine grain (narrow bandwidth) traffic on demand. It 
is therefore advantageous if a switch can be provided which supports a switching 
operation over a plurality of different switching granularities, or different granularity 
switching levels. Such a switch can be conceptually perceived to have a layered 
structure. The central or core switching layer providing the coarsest granularity 
switching operation and each subsequent layer providing a finer granularity 
switching operation than the layer before. This layered architecture may or may not 
be reflected in the physical structure of the switch. It is extremely important that the 
architecture of any large bandwidth switch providing a fine granularity (narrow 
bandwidth) switching operation permits the switch to be suitably non-blocking. 



SUMMARY OF THE INVENTION 



One object of the invention seeks to obviate and/or mitigate the above problems 
known in the art by providing a non-blocking high capacity fine grain switch for use 
5 in a communications environment. 

Another object of the invention seeks to provide a method of controlling traffic in a 
non-blocking high capacity fine grain switch. 

10 Another object of the invention seeks to provide a communications network 
including a non-blocking high capacity fine grain switch. 

Yet another object of the invention seeks to provide a switch node forming part of a 
non-blocking high capacity fine grain switching. 

15 

A first aspect of the invention seeks to provide a high capacity switch for switching 
communications traffic, the high capacity switch having: 

a plurality of differing granularity switching levels, each switching level having 
at least one switch node capable of performing a switching operation at the 
20 granularity of the switching level; 

at least two primary connections, each connecting one of the switching levels 
to another one of the switching levels, wherein 

at one of the switching levels, at least one switch node is capable of switching 
communications traffic along at least one switch connection path established along 
25 one of the primary connections, and is capable of switching communications traffic 
along at least one secondary connection to another switch node within the same 
switching level, such that each of the at least one switch connection paths 
established is filled to a predetermined level. 

30 Preferably, the pre-determined level is the maximum traffic capacity of the switch 
connection path. 

Advantageously, each at least one secondary connection is configured to have a 
traffic capacity so that the high capacity switch is non-blocking. 

35 
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Preferably, at least one secondary connection comprises a permanent connection. 



More preferably, every secondary connection comprises a permanent connection. 

5 Preferably, one of the switching levels which performs the coarsest granularity 
switching operation has one switch node. 

Each switch node in one of the switching levels may comprise a plurality of switches, 
each switch being capable of operating at the granularity of the one of the switching 
1 0 levels. 

Preferably, the traffic capacity of the at least one secondary connection in a first one 
of the switching levels is determined by the capacity of the at least one switch 
connection path to a second, coarser, one of the switching levels which is capable of 
1 5 providing a coarser granularity switching operation than the first one of the switching 
levels. 

Preferably, the traffic capacity of the at least one secondary connection in a first one 
of the switching levels is substantially the same as the capacity of the at least one 
20 switch connection path to a second one of the switching levels which is capable of 
providing a coarser granularity switching operation than the first one of the switching 
levels. 

Preferably, the traffic capacity of the at least one secondary connection in a first one 
25 of the switching levels is larger than the capacity of the at least one switch 

connection path to a second one of the switching levels which is capable of providing 
a coarser granularity switching operation than the first one of the switching levels. 

The high capacity switch according to the first aspect of the invention may have two 
30 differing granularity switching levels. 

Alternatively, the high capacity switch according to the first aspect of the invention 
may have three differing granularity switching levels. 
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Alternatively, the high capacity switch according to the first aspect of the invention 
may have more than three differing granularity switching levels. 

In the specific embodiment of the invention where the high capacity switch according 
5 to the first aspect of the invention has two differing granularity switching levels, the 
traffic capacity of the at least one secondary connection in a one of the switching 
levels providing a finer granularity switching operation may be approximately equal to 
the granularity of a switching operation in a one of the switching levels providing a 
coarser granularity switching operation. 

10 

In the specific embodiment of the invention where the high capacity switch according 
to the first aspect of the invention has three different granularity switching levels, the 
traffic capacity of the at least one secondary connection in one of the switching 
levels providing a finest granularity switching operation may be approximately equal 

1 5 to the granularity of a switching operation in one of the switching levels providing an 
intermediate granularity switching operation, and the traffic capacity of the at least 
one secondary connection in the one of the switching levels providing an 
intermediate granularity switching operation may be approximately equal to the 
granularity of the switching operation of in one of the switching levels providing a 

20 coarsest granularity switching operation. 

The high capacity switch according to the first aspect of the invention may be 
capable of switching traffic which is coarser than the granularity of the switching 
operation provided by a switch node in a first one of the switching levels by routing 
25 traffic through to a second one of the switching levels which is capable of providing a 
coarser granularity switching operation than the operation provided by the first one of 
the switching levels. 

Preferably, at least one switch node of a one of the switching levels which provides 
30 the coarsest granularity switching operation is capable of establishing at least one 
secondary connection between a pair of switch nodes in a second one of the 
switching levels which provides a finer granularity switching operation. 

At least one secondary connection may be provided externally to a one of the 
35 switching levels which provides the coarsest granularity switching operation. 
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The switch node of a one of the switching levels which provides the coarsest 
granularity switching operation may include an optical switch. 

5 The switch node of a one of the switching levels which provides the coarsest 
granularity switching operation may be transparent to the type of traffic. 

The high capacity switch may be capable of switching both time division multiplexed 
traffic and wavelength multiplexed traffic. 

10 

The high capacity switch may be capable of switching SONET/SDH traffic. 

The high capacity switch may be capable of switching both SONET/SDH and 
wavelength traffic. 

15 

At least one switch node may be capable of switching a lower order SDH/SDH virtual 
container. 

At least one switch node may be capable of switching higher order SDH/SDH virtual 
20 containers . 

At least one switch node may be capable of switching a plurality of higher order 
SDH/SDH containers. 

25 Preferably, at least one switch node in one of the plurality of switching levels is 
capable of switching lower order virtual containers, and at least one other switch 
node in another of the plurality of switching levels is capable of switching higher order 
virtual containers. 

30 In the specific embodiment of the invention wherein the high capacity switch 

according to the first aspect of the invention has at least three switching levels, at 
least one switch node in a first one of the plurality of switching levels may be 
capable of switching lower order virtual containers, and at least one switch node in a 
second one of the plurality of switching levels may be capable of switching higher 

35 order virtual containers, and at least one switch node in a third one of the plurality of 
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switching levels may be capable of switching a plurality of higher order virtual 
containers. 

The high capacity switch may be distributed over a communications network. 

5 

The high capacity switch may be incorporated into a telecommunications network. 

A second aspect of the invention seeks to provide a switch of granularity M 
comprising: 

10 a switch core including a coarse grain switch of granularity N; 

a plurality of switch nodes, each switch node comprising at least one fine 
grain switch of granularity M finer than N, the switch core being capable of 
establishing a switch connection path with any of the switch nodes; and 

a plurality of permanent connections, each permanent connection connecting 
1 5 two fine grain switches, wherein the permanent connections are configured to permit 
the switch to be non-blocking, and wherein 

a minimum number of switch connection paths are established, the switch 
connection paths being filled to capacity with traffic routed through the switch and 
wherein residual traffic is routed along permanent connections. 

20 

Preferably, the traffic capacity of each permanent connection between any pair of 
fine grain switches is substantially equals to the granularity N of the coarse grain 
switch. 

25 A third aspect of the invention seeks to provide a method of controlling traffic to be 
routed through a high capacity switch according to the first aspect of the invention, 
the method comprising the steps of: 

assessing traffic received at a switch node in a finer granularity switching 

level; 

30 at the switch node in the finer granularity switching level, 

switching traffic capable of filling to capacity an exact number of switch 
connection paths along a primary connection along the exact number of switch 
connection paths to a next coarser granularity switching level switch node, and 
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switching residual traffic not capable of filing a switch connection to capacity 
along a secondary connection to another switch node in the finer granularity 
switching level; and 

reconfiguring the number of switch connections established in 
accordance with any variation in the traffic to ensure that a minimum number of 
switch connections is always established from the finer granularity switching level to 
the next coarser granularity switching level. 

Preferably, the step of reconfiguring maintains the synchronization of traffic at a 
destination. 

Preferably, the step of reconfiguring uses a hitless technique. 

A fourth aspect of the invention seeks to provide a communications network including 
a high capacity switch for switching communications traffic according to a first aspect 
of the invention. 

A fifth aspect of the invention seeks to provide a switch node forming part of a high 
capacity switch for switching communications traffic according to the first aspect of 
the invention. 

Any features of the above aspects may be suitably incorporated in any of the above 
aspects as would be apparent to a person skilled in the art. 

Advantageously, the invention provides a high capacity switch in which secondary 
connections within a switching level are configured so that the switch is not blocked, 
and so that the high capacity switch is non-blocking as a whole. The invention thus 
provides a non-blocking high capacity fine grain switch which is capable of adopting 
a nested hierarchy of switching levels, or switch layers, so as to build up successive 
levels of switching granularity. Traffic is able to bypass the finer granularity 
switching level to reach the coarse granularity switching level. 

Within each finer switching level, permanent connections are established between 
the switch nodes. Each switch node in a switching level is capable of establishing a 
switch connection to at least one, and preferably all switch nodes in the next, finer 
granularity switching level . The permanent connections of each finer switching level 



are preferably configured to have a capacity substantially equivalent to a switch 
connection to the next, coarser, switching level. 

This provides the advantage that a non-blocking high capacity fine grain switch can 
be provided. The switching levels may be "layered" and/or the switch nodes 
distributed over a communications network. In this manner a distributed switch 
architecture is provided for a non-blocking high capacity fine grain switch which is 
capable of routing a large traffic bandwidth yet which retains the ability to switch 
traffic of finer granularity. 

The coarsest granularity switching level may be transparent to data type, so as to 
enable both TDM and wavelength traffic to be switched. It is also possible for 
photonic switch(es) to be incorporated into switch node(es) as appropriate. This 
would enable optical traffic to be routed directly without the need for electro-optical 
conversion at the switch nodes. 

Traffic routed through the high capacity fine grain switch is received by a switch node 
in the switching level providing the finest granularity switching operation. The 
progress of traffic through the high capacity switch is assessed by appropriate control 
elements within the high capacity switch or by network management software: 

i) assessing how many switch connection paths the traffic stream has the 
ability to fill to capacity; 

ii) Routing traffic to the switch node(s) in a coarser granularity 
switching level only along switch connections which are full to capacity; 

iii) Routing any residual traffic along a secondary connection to the appropriate 
destination switch node within the switching level; and 

iv) Reconfiguring the path of traffic through the switching level(s) as appropriate 
to ensure that only the minimum number of switch connection paths are 
maintained. 

In this manner, the switch connections are maintained in either a full or an empty 
state, increasing the probability that the high capacity switch is not blocked, and 



increasing the efficiency of the switching operation of the coarsest switching level 
switch node, or switch core. 

Traffic along the switch connections and secondary connections can be monitored by 
5 any suitable monitoring means, such as are known in the art, and the most efficient 
route for the traffic through the switch determined. In the case where traffic routed 
along a secondary connection reaches a predetermined amount, for example, when 
traffic is capable of filling a switch connection to capacity, the traffic is re-routed 
along the switch connection. In the case where traffic has been routed along a 
10 switch connection falls to a lower predetermined amount, the traffic may be re-routed 
along a secondary connection leaving the switch connection empty. The 
reconfiguration is preferably hitless to ensure that traffic is appropriately 
synchronized at its destination regardless of the route taken through the switch. 

1 5 BRIEF DESCRIPTION OF THE DRAWINGS 

The above objects, advantages and features of the invention will become apparent 
from the following description, taken in conjunction with the accompanying drawings 
which are by way of example only and in which: 

20 Fig. 1 A is a sketch of a high capacity fine grain non-blocking switch according a first 
aspect of the invention; 

Fig. 1 B shows a diagram illustrating an example of connections in a switch 
according to Fig. 1A; 

Fig. 2 is a sketch of a high capacity blockable switch; 
25 Fig. 3 is a sketch of a transparent switch node according to an embodiment of the 
invention; 

Fig. 4 is a sketch of a wavelength switch incorporated in a switch node according to 
another embodiment of the invention; 

Fig. 5A sketches a switch having three different granularity switching levels 
30 according to another embodiment of the invention; 

Fig 5B shows a diagram illustrating an example of connections in a switch according 
to Fig. 5; and 

Fig. 6 sketches a traffic routing method according to a second aspect of the 
invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



There will now be described by way of example the best mode contemplated by the 
inventors for carrying out the invention. In the following description numerous 
5 specific details are set forth in order to provide a thorough understanding of the 
present invention. It will be apparent however, to one skilled in the art, that the 
present invention may be practiced without limitation to these specific details. In 
other instances, well known methods and structures have not been described in 
detail so as not to unnecessarily obscure the present invention. Numerical examples 
1 0 used are to clarify operation and are not chosen to reflect real equipment sizes or to 
show an efficient implementation. References to SONET are intended to include 
references to the SDH equivalent, and vice versa as would be obvious to one skilled 
in the art. 

15 Fig. 1 A illustrates a high capacity fine grain non-blocking switch 1 according to one 
embodiment of the invention. In Fig. 1 A, different levels of switching are represented 
by different layers of the switch 1. In Fig. 1A, the high capacity fine grain switch 1 
supports two different levels of switching granularity, a first switching level ("CL") 
which provides a coarse granularity switching operation and a second, outer, 

20 switching level ( "FL") which provides a finer granularity switching operation than the 
first layer and which determines the finest bandwidth of traffic which the high capacity 
fine grain switch is able to switch. 

In Fig. 1A, the second granularity switching level "FL" supports switching at 
25 granularity "M" (see Fig. 1 B), and incorporates three switch nodes 2, 3, 4. Each 
switch node 2, 3, 4 contains a switch which can switch traffic at the granularity M. 
Each switch node also enables coarser grain traffic to be routed through to the first 
switching level. 

30 Alternatively, a switch node can include more than one switch provided these are 
suitably configured to co-operate. 

The coarse switching level "CL" represented by the inner, first layer of the switch 
includes one switch node 5, which functions as the core of the high capacity fine 
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grain switch 1 . Alternative embodiments may include more than one switch node 
arranged to collectively function as a switch core. 

The switch node 5 is capable of performing a switching operation of granularity N, 
5 where N is coarser than M. Traffic is received at the switch node 5 only from the 
second switching level FL by a second level switch node 2, 3, 4 . The switch node 5 
is able to perform a coarse granularity switching operation on the received traffic at 
high speeds without any need to extract fine granularity traffic. 

1 0 Traffic is received by the high capacity switch 1 via the fine granularity switching level 
FL along a suitably configured port 12, 13, 14 for the appropriate receiving switch 
node 2, 3, 4. Each external facing port 12, 13, 14 enables traffic in the second, fine 
granularity, switching level FL to interface to the communications network outside the 
high capacity fine grain switch. 

15 

Each switch node 2, 3,4 in the fine granularity switch level FL also has at least one 
primary connection port (not shown). The primary connection ports support primary 
connections 9, 10, 11 with the primary connection ports (not shown in Fig. 1A) of the 
coarse granularity switching level switch node 5. 

20 

Within the fine switching level FL, each switch node 2, 3, 4 is connected by a 
secondary connection 15, 16, 17 to each of the other switch nodes 2, 3, 4 in the 
switching level FL. The secondary connections may, for example, be permanent 
connections, and are permanent connections in the best mode of the invention. The 
25 fine switching level is connected to the coarse switching level CL, by primary 

connections 9,10, 11. The coarse switching level switch node 5 can establish switch 

connection paths 9a d, 10a,...,d, 11a,...,d at granularity N along primary 

connections 9,10,11. 

30 Fig 1 B illustrates diagrammatically how switch connection(s) are established along 
primary connection(s) 9, 10, 1 1. In Fig. 1B, traffic arriving at switch node 2 is 
destined in part for switch node 3. The traffic arriving is equivalent to a full switch 
connection path to switch node 4, and more than a full switch connection path to 
switch node 3, but not sufficient to fill two switch connection paths to capacity. 

35 Accordingly, the traffic is routed along two switch connection paths to the coarse 
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switching level switch node 5. Thus switch connection paths 9a, b are empty and 
switch connection paths 9c, d are full. The residual traffic arriving at switch node 2 
which is not capable of filling a switch connection path to capacity is switched along 
secondary connection 15. 

5 

The switch node 5 in the coarse granularity switching level thus only performs a 
switching operation on traffic arriving along full switch connection paths 9c, d. Traffic 
arriving destined for switch node 3 is then routed along switch connection path 10b to 
the fine granularity switching level switch node 3. Traffic for switch node 4 is routed 
1 0 along a switch connection path along primary connection 1 1 . 

In the specific embodiment illustrated in Fig. 1A, each fine grain switch 6, 7, 8 is a 
SONET STS-1 cross-connect, and the switch node 5 includes a 2.5Gbit/s crosspoint 
coarse grain switch as the switch core. Alternatively, the switch core could include 
15 an electro-optical or photonic cross-connect or an asynchronous switch matrix. 

In the best mode contemplated for the invention, each permanent connection 15, 16, 
17 has approximately the same capacity as the granularity N of the switch node 5. 
However, in alternative embodiments of the invention, the capacity of each 
20 permanent connection 15, 16, 17 in the fine granularity switching level may be 

different from the granularity of the switch node 5 in the coarse granularity switching 
level, providing the result supports the high capacity switch being non-blocking in the 
sense described in more detail herein below. 

25 Each switch in one of the fine granularity switch nodes 2, 3, 4 has a capacity of 25 
Gbit/s. Each switch thus has 10 Gbit/s for the external facing port(s), 10Gbit/s for the 
primary connection port(s), and 2.5Gbit/s for each of the two permanent connections 
connecting the switch to another switch nodes within the fine granularity switching 
level. 

30 

The total capacity of the coarse granularity switching level switch node 5 is 30 Gbit/s 
which enables up to four 2.5 Gbit/s switch connections to be established between 
each of the three switch nodes 2, 3, 4 in the fine granularity switching level FL. 
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The capacity of the high capacity non-blocking switch is thus determined by the 
capacity of the coarse switching level switch node 5, here 30Gbit/s. In this 
embodiment therefore, a 30 Gbit/s layered switch has been provided which has a 
switching granularity of STS-1 , (i.e. approximately 50 Mbit/s). This provides a 30/25 
5 gain in capacity compared to the individual fine grain switches of each higher layer 
switch node 2, 3, 4. 

In alternatively, more practical embodiments, more fine grain switches could be 
included within each switch node 2, 3, 4 to increase the capacity of each switch 
1 0 node 2, 3, 4 in the fine granularity switching level FL compared to the switching 
granularity of the coarse granularity switching level CL switch node 5 and/or more 
fine grain switch nodes used. 

The operation of a layered switch according to the invention will now be described 
15 with reference to Fig. 1A and Fig. 2 of the accompanying drawings. 

Consider when traffic is received by switch node 2 from port 12. When the required 
traffic connectivity changes, the received traffic is assessed to determine its 
capability to fill switch connections to capacity. The switch node in the coarse 
20 granularity switching level establishes the required number of switch connection 

paths along the primary connections. For example, the number of switch connection 
paths, along primary connections 9 and 10 between the receiving switch node 2 and a 
destination switch node 3. 

25 Residual traffic, being traffic which is not capable of filling a switch connection to 
capacity is routed by the switch node 2 along permanent connection 15 to switch 
node 3. Thus residual traffic remains within the fine granularity switching level and 
does not need to access the switch node 5 of the coarse granularity switching level. 
Similarly, traffic received by switch node 2 with the destination switch node 4 is either 

30 routed along switch connection paths along primary connections 9 and 1 1 or along 
permanent connection 17. 

The number of switch connection paths required is reassessed as traffic is routed 
through the switch. Traffic is suitably monitored to determine the most efficient use of 
35 the switch connection paths established by the first switch layer switch node, and to 
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gauge the need to switch traffic between a switch connection path and a secondary 
connection. 

In summary therefore, traffic at the ports 12, 13, 14 in the fine granularity switching 
5 level is routed by a fine grain switch 6, 7, 8 either via switch core 5 along switch 
connections within primary connections 9, 10, or 11 or along secondary 
connection(s)15, 16, 17. In this manner, switch 1 switches the traffic between the fine 
granularity ports 12, 13, 14. 

1 0 The non-blocking configuration of the high capacity fine grain switch shown in Fig. 1 A 
can be appreciated by contrast with a blocking high capacity fine grain switch 18 
shown in Fig. 2. In Fig. 2, a high capacity fine grain switch 18 comprises a coarse 
grain switch connected to a number of fine grain switches. That the configuration of 
the switch shown in Fig. 2 is blocking is obvious to those skilled in the art. This can 

15 be demonstrated with the following example. 

Referring now to Fig. 2, consider the situation where the contents of 10Gbits/s traffic 
streams are to be switched between ports 22, 23, 24. The high capacity fine level 
switch 18 comprises switch nodes 25, 26, 27 and a switch core 28. The switch core 
20 28 is capable of performing a coarser granularity switching operation than the switch 
nodes 25, 26, 27 are capable of performing. 

Consider the case where the switch core 28 is an asynchronous switch with a 
switching granularity of 2.5 Gbits/s. The switch core 28 is capable of establishing 
25 four switch connection paths (not shown) along primary connections 29, 30, 31 to 

each switch node 25, 26, 27. Each primary connection can therefore comprise up to 
four switch connection paths, where each switch connection path has a capacity of 
2.5 Gbit/s. The coarse granularity switch core thus has an overall switching capacity 
of 30Gbit/s. 

30 

Traffic T arriving along port 22 consists of 10Gbit/s of SONET STS-1s, which is 1 92 
STS-1s. One STS-1 traffic stream is to be switched to port 23 with the remaining 
traffic (191 STS-1 s ) to be switched to port 24. The switch core 28 provides a switch 
connection path to enable the STS-1 traffic to reach switch node 26. This reduces 
35 the available bandwidth into the switch core 28 by 2.5 Gbit/s, leaving only three 
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available switch connection paths, each having a capacity of 2.5 Gbit/s. However, 
7.5 Gbit/s is insufficient to route the remaining traffic to switch node 27, and thus the 
high capacity fine grain switch 18 is blocked. 

5 Referring now the high capacity fine grain switch 1 shown in Fig. 1A, in the situation 
where 10 Gbits/s traffic streams are to be routed between switch nodes 2, 3, 4 and 
the first switch layer switch node 5 includes an asynchronous switch with a switching 
granularity of 2.5 Gbits/s, similar traffic conditions do not block switch 1 . Consider 
the case again where traffic T arriving at port 12 consists of 10Gbit/s of SONET 
10 STS-1s, or 192 STS-1s. One STS-1 traffic stream is to be switched to port 14 with 
the remaining traffic ( 191 STS-1 s ) to be switched to port 13. 

The coarse granularity switching level switch node 5 is capable of providing up to 
four switch connection paths, each switch connection having a 2.5 Gbit/s capacity, to 
15 each switch node 2, 3, 4 in the fine granularity switching level. 

However, as each permanent connection 15, 16, 17 has a capacity equal to the 
capacity of one switch connection path, the switch is non-blocking. Switch node 2 is 
able to route the single STS-1 traffic stream along the permanent connection 17 to 
20 enable the single STS-1 traffic stream to reach switch node 4. As 48 STS-1 s fill a 
2.5 Gbit/s switch connection, the remaining 191 STS-1s are routed to switch node 3 
as follows: 

i) two full switch connections along primary connections 9, 10 are 
established by the coarse switching level switch node 5 between the fine granularity 

25 switching level switch nodes 2 and 3, and 

ii) the residual traffic, the remaining 47 STS-1 s, is routed along the 
permanent connection 15 between switch nodes 2 and 3. 

In this way, the coarse granularity switching level switch node 5 establishes only 
30 sufficient switch connection paths to carry traffic to their full capacity, maintaining the 
efficiency of the switch connections. Residual traffic, i.e., further STS-1 connections 
which are capable of only partially filling a switch connection are routed along a 
secondary connection. 
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Thus despite the switching granularity of the switch node of the coarse granularity 
switching level being 2.5 Gbit/s, single STS-1 (i.e. 50 Mbit/s bandwidth) traffic can 
be switched and not leave the switch vulnerable to blocking. 

5 All non-broadcast connections will not block the high capacity fine granularity switch 
1 , providing suitable secondary connections are configured in the fine granularity 
switching level. This requires each secondary connection to have a capacity equal to 
( or greater than) the capacity of each switch connection path, and requires suitable 
re-routing to occur to maintain the number of switch connection paths established at 
10 a minimum. 

In another, more practical embodiment of the invention, eight switch nodes are 
providing in the fine granularity switching level. Each fine granularity switching level 
switch node includes a fine grain switch which has 80 Gbit/s capacity for external 
1 5 facing ports. Each fine grain switch supports up to 8 x 4 switch connections, each 
switch connection having a capacity of 2.5 Gbit/s. Thus in this embodiment, the 
coarse granularity switching level switch node is capable of providing up to 80 Gbit/s 
in switch connection paths to any of the fine granularity switching level switch nodes. 

20 Each switch node in the fine granularity switching level also has seven secondary, 
e.g. permanent, connections to the other switch nodes within the fine granularity 
switching level, each permanent connection having a capacity of 2.5Gbit/s. . 

In the above embodiments of the invention, a switch in a fine granularity switching 
25 level switch node, is constructed so that traffic which requires switching between 
individual external facing input/output ports of the switch node can be switched 
directly by the relevant switch node. 

Alternatively, an implementation can be realized in which each fine granularity 
30 switching level switch node comprises a first and a second part. The first part can 
input traffic from an external facing port and route it towards the internal part port(s) 
facing the coarse granularity switching level switch node. The second part can 
output traffic received along a switch connection towards external facing port(s). 
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This embodiment requires an additional connection, for example a permanent link, 
to be added between the two parts, and enables the capacity of the high capacity 
non-blocking switch to be effectively doubled in cases where the capacity of the 
switch is limited by the finite capacity of the fine grain switch(es) comprising each 
5 switch node in the fine granularity switching level. 

In a best contemplated mode of the invention, the high capacity fine grain switch 1 is 
transparent to traffic type, so that both time division multiplexed traffic (TDM) traffic, 
for example SONET or SDH traffic, as well as wavelength traffic can be switched. In 
1 0 such embodimentes, at least the coarsest granularity switch node(s), e.g. the switch 
core, is (are) transparent to traffic type in this manner. 

Fig. 3 illustrates an embodiment in which both TDM and wavelength traffic can be 
switched when the coarse granularity switching level switch node 5 of Fig. 1 includes 
1 5 an optical or asynchronous electronic switch . Fig. 3 illustrates a tributary unit 40 
connected to a switch node 2 (which here, for example, is shown as comprising 
switch 2a, and protection switch 2b) of the fine granularity switching level FL (see 
also Figs. 1 A and 1 B for example). Other tributary units connected to the coarse 
granularity switching level switch node 5 are not shown for clarity. 

20 

In Fig. 3, the switch node 2 traffic and equipment protection is supported by 
providing two fine grain switches 48a and 48b. External facing port 12 supports 
traffic T which is routed through the tributary unit 40 via access port 41 . Traffic T is 
assumed to be on an optical fiber and may contain a signal which is a SONET TDM 
25 multiplexed signal or which is a signal being transported transparently on a 

wavelength of light. Within the tributary unit 40, electronic data is converted into 
optical data by a suitable electro-optical interface (EOI) 42. A switch 43 enables 
data to bypass the SONET overhead processor (OHP) 44 if SONET processing is 
not required. 

30 

Fig. 3 supports both path and/or equipment protection. In Fig. 3 it is assumed that 
the coarse granularity switching level switch node 5 incorporates appropriate 
protection measures. Thus switch node 2 and the connections from switch node 2 
to the tributary unit 40 are shown in duplicate to illustrate the path protection. For 
35 equipment protection, user input traffic is broadcast from the input 41 over both 
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routes A and B. At the output for both transparent signals and non-path protected 
SONET signals, switches 43, 45 select from either route A or route B. In this way 
equipment failures on a single route do not impair the switching operation. For 
transparent signals, the fine grain switches in 2a ( 47a) and in 2b are bypassed. This 
5 is illustrated by switch 48a in 2a. 

In SONET and SDH networks a technique called path protection may be used, in 
which , a single STS-1 may be broadcast over two different routes across a city , a 
country or even further. At the point where the signal leaves the network or joins 
1 0 another network, the signal exhibiting the best required characteristics is selected. 
In the embodiment illustrated in Fig. 2, VTU 46 performs appropriate signal 
selection. 

The invention thus enables the switch node to bypass SONET processing, and so 
1 5 retain the ability to use the native capability of the coarse grain switch incorporated 
in the switch node of the first switch layer. 

The high capacity fine grain 1 may support a purely optical network in one 
embodiment of the invention. Referring again to Fig. 1 A, in this embodiment of the 
20 invention each switch node 2, 3, 4 in the fine granularity switching level incorporates 
a fine grain wavelength switch and the first layer switch node is a coarse grain 
photonic switch, for example, a MEMS-type device. 

Referring now to Fig. 4, a typical wavelength switch 50 suitable for incorporation into 
25 a higher layer switch node 2,3, 4 is sketched. The wavelength switch 50 is able to 
switch a signal on any incoming wavelength to the same or a different output 
wavelength. Fig. 4 illustrates how the DWDM (Dense Wavelength Division 
Multiplexed) signal input to the wavelength switch 50 contains a number N of 
different wavelength X input signals per fiber. 

30 

However, a coarse grain photonic switch is only capable of switching all the light 
along any given input to an output, i.e., all wavelengths received along a switch 
connection path from a switch node in the adjacent fine granularity switching level 
are switched together to another switch connection path to another switch node in 
35 the adjacent fine granularity switching level. 
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Switching matrix sizes in both photonic and wavelength switches of about 1000 ports 
are known. Each fiber may support up to 40 signals each using a different 
wavelength. Therefore each fine grain wavelength switch is limited to switching the 
5 signals inside only about 25 fibers. A switch constructed to have an architecture as 
indicated by Fig. 1A therefore permits much larger non-blocking wavelength switches 
to be provided. 

A method of routing traffic through a high capacity fine grain switch such as Fig. 1A 
1 0 illustrates will now be discussed. As new connections to the high capacity fine grain 
switch 1 are required, which may be initiated by management or signaling systems, a 
suitable connection control mechanism establishes an appropriate route through the 
switch 1 . The connection control mechanism may be implemented in any suitable 
manner, by any conventional or state-of-the art means. Traffic routed over the switch 
1 5 is monitored as in order to avoid blocking, it is necessary that a switching level 

coarse granularity switch only connects full switch connection paths and for residual 
amounts of traffic to be routed along secondary connections. 

The dynamic nature of traffic requires a means to reroute traffic as traffic levels rise 
20 and fall either along a secondary connection or along a switch connection path. To 
ensure that the secondary connections only carry residual amounts of traffic, 
suitable traffic management control is implemented at each switch node to reroute 
traffic as appropriate. Means to control routing is implemented either by the high 
capacity fine grain 1 , first layer switch node, the higher layer switch nodes 2, 3,4 
25 and/or by a suitable network management system. In the event traffic decreases in 
one of the switch connection paths 9,10,1 1 , a proportion of traffic from one of the 
switch connection paths 15,16 or 17 is re-routed to maintain the switch connection 
path full. 

30 The switch nodes of the fine granularity switching level work together to maintain 
each switch connection path full or empty by shuffling traffic to and from the 
secondary connections 15, 16, 17. Fig. 6 illustrates how traffic is assessed to 
maintain only switch connection path(s) which are full to capacity or empty and how 
residual traffic is routed along the secondary connections. 
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As Fig. 6 indicates, since the above 'shuffling' affects established switch connection 
paths, it must be accomplished in a manner which does not cause any errors in the 
traffic stream. Any suitable technique can be used, for example, hitless rollover. 
Using such a technique, a higher layer switch node 2, 3, 4 broadcasts the traffic to 
5 be rolled along both the secondary connection and the switch connection path to the 
destination switch node in the fine granularity switching level. 

The destination switch node then selects to input the traffic from the new route 
instead of the old. Once the selection has been made, the source switch node stops 
1 0 sending the traffic on the original route. In order for the selection to be 'hitless', the 
traffic streams arriving on the two routes must be exactly in phase. Appropriate 
mechanisms are provided by any suitable conventional mans to minimize the delay 
difference along the two routes, together with a suitable mechanism for measuring 
and adjusting the actual delay. 

15 

For example, in a SONET/SDH embodiment of the invention, where an 
asynchronous coarse grain switch is incorporated in a coarsest granularity switching 
level switch node, the switch node should introduce negligible extra delay and cable 
length differences will provide the dominant delay contribution. The defined frame 
20 pattern in SONET/SDH enables the delay factor to be recognized and electronic 

memory ( elastic stores ) are able to buffer signals to automatically adjust the delay. 
In the best mode contemplated, the finer granularity switching level switch nodes 
incorporate fine grain switches which are suitably synchronized across all finer 
granularity switching levels. 

25 

In a wavelength switching application, the same basic hitless rollover technique 
could be used. The recent standardization by ITU G.709 ensures that a suitable 
recognizable framing pattern is present on all wavelength signals, it is therefore 
necessary to adjust the delay of one signal relative to another until the framing 
30 patterns line up sufficiently. Such adjustment can be accomplished using materials 
whose refractive index can be varied in a controlled manner, such as by varying their 
temperature. 
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In some applications, the absolute size of the high capacity fine grain switch may 
require the coarse granularity switching level switch node to incorporate a coarse 
grain switch with extremely large granularity. 

For example, a coarse granularity switching level switch node incorporating a coarse 
grain switch with 2.5Gbit/s switching granularity requires each permanent connection 
in the next finer granularity switching level to have a 2.5Gbit/s capacity to avoid 
blocking. Each switch node in the switching level providing the next finer granularity 
switching operation must support a number of switch connections inside the 
2.5Gbit/s primary connections to the coarse granularity switching level switch node 5 
and a secondary connection of 2.5Gbit/s to each of the other switch nodes in the 
same switching level. 

Accordingly, each switch node therefore is restricted to a certain minimum size of 
fine grain switch(es), and the permanent connections to other fine grain switch(es) 
(whether within the switch node or to the fine grain switch(es) of other switch nodes 
in the same switching level) occupy some of the switch capacity, and therefore 
represent some inefficiency. 

To overcome this, additional fine granularity switching levels may be added, for 
example, such as the three layer non-blocking high capacity fine grain switch 60 
sketched in Figs. 5A and 5B. In Figs. 5A and 5B, an additional level of switching 
granularity has been provided. This is represented by the third switch layer FFL. In 
Fig. 5A, the third switching level FFL incorporates switch nodes 73,74,75. Each 
switch node 73,74,75 has a switch providing a finer granularity switching operation 
than that which is provided in the middle granularity switching level FL by the fine 
granularity switches incorporated in each switch node 2, 3, 4. 

The switch nodes of the finest granularity switching level FFI_(i.e., the third layer in 
Fig. 5A) determine the granularity of the high capacity fine grain as a whole. As 
Fig. 5A illustrates, within the finest granularity switching level FFL, secondary 
connections 76, 77, 78 are provided to inter-connect the switch nodes 73, 74, 75 of 
that switching level. Such secondary connections are permanent connections, as 
are the secondary connections 15, 16, 17 within the second layer in Fig. 5A 
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(representing the intermediate granularity switching level FL) in the best mode 
contemplated for the invention. 

The different levels of switching granularity are interconnected by primary 
5 connections 9, 10, 11, 70, 71 , 72 between the switch node(s) of the interconnected 
levels. The capacity of each switch connection formed along a primary connection 
between two levels of switching granularity is determined by the coarser granularity 
switching operation supported by a switch node in the coarser of the two inter- 
connected switching levels. Each switch node in the coarser of two inter-connected 
10 switching levels can establish at least one switch connection path to a switch node in 
the finer switching level. 

Thus switch connection paths can be established by the switch node 5 along 
appropriate primary connections 9, 10, 1 1 to the switch nodes 2, 3, 4 in the next 
1 5 finer granularity switching level FL. Switch connection paths can be established by 
switch node 2 in the finer granularity switching level FL to the next finer granularity 
switching level FFL switch node 76 along primary connection 70. Similarly, switch 
nodes 3, 4 can establish switch connections along primary connections 71 ,72 to 
switch nodes 74, 75 respectively. 

20 

In Fig. 5A, the first switching level CL is represented as the innermost layer and 
comprises a switch node 5 incorporating a switch core capable of switching traffic at 
the coarsest switching granularity or largest bandwidth. The second switching level 
FL is represented as the intermediate layer. Each of the intermediate layer switch 
25 nodes 2, 3, 4, incorporate switch(es) capable of switching narrower bandwidths than 
the switch node 5. The third switching level FFL is represented as the outermost 
layer. Each of the outer layer switch nodes 73, 74, 75 incorporate switch(es) which 
are capable of switching narrower bandwidths than the switch nodes 2, 3, 4 of the 
intermediate layer. 

30 

In this manner, therefore, the switching operation of the switching levels can be 
successively nested so progressively narrower bandwidth traffic can be switched yet 
the overall capacity of the switch retained. In other embodiments, therefore, 
successively finer granularity switching levels can be added to the switch, and the 
35 switching granularity made even finer. Each successive switching level having at 
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least one switch node which incorporates switch(es) of even finer granularity than 
the switches in the switch nodes of the previous level. 

The outmost "layer" of the overall switch as Fig. 5A illustrates, thus provides the 
5 finest granularity switching level and contains switch node(s) which incorporate the 
finest granularity switch(es). The granularity of the finest granularity switching level 
thus determines the switching granularity of the high capacity fine grain switch as a 
whole. This 'nesting' of the switch layers enables extremely large switches to be 
supported which are also capable of switching appropriately fine grain traffic. 

10 

A three switching level high capacity fine grain switch 60 such as is sketched in Fig. 
5A, can comprise a 2.5Gbit/s asynchronous switch within switch node 5, SONET 
STS-1 switches within the switch nodes 2, 3,4 and SONET lower order container ( 
VT ) switches within the switch nodes 73, 74, 75. 

15 

The switch node 5 would be capable of establishing 2. 5 Gbit/s switch connection 
path(s) to each switch node 2, 3, 4 in the next finer granularity switching level FL. 
Each secondary connection within the finer granularity switching level FL has a 
capacity of 2.5 Gbit/s to ensure the finer granularity switching level FL and the 
20 coarse granularity switching level CL were non-blocking. 

Each switch node 2, 3, 4 in the finer granularity switching level FL is capable of 
establishing a switch connection path with at least one switch node 73, 74, 75 in the 
next, finest granularity switching level FFL along a primary connection 70, 71 , 72. 
25 Within the finest granularity switching level FFL, secondary permanent connections 
76, 77, 78 interconnect the switch nodes 70, 71 , 72. Each secondary permanent 
connection 76, 77, 78 has a capacity of an STS-1 (approximately 50M bit/s). 

Numerous modifications and variations to the features described above in the 
30 specific embodiments of the invention will be apparent to a person skilled in the art. 
The scope of the invention is therefore considered not to be limited by the above 
description but is to be determined by the accompanying claims. 

For example, it will be obvious to a person skilled in the art that not all switch nodes 
35 within a switching level may need to be connected to each other, and that the 
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switches in each switch node surrounding a switch core may not all be identical, for 
example, within a single granularity switching level, each switch node may support a 
different type of switch. Moreover, there need not be one-to-one correspondence 
between the number of switch nodes in different switching levels. For example, it 
5 may be that within a finer switching level more switch nodes are provided than within 
the next coarser switching nodes. 

Whilst the switches illustrated demonstrate a layered architecture, physical devices 
may not necessarily implement such a structure. Moreover, the switch may be 
1 0 distributed over the network with switch nodes remotely located or have switch nodes 
co-located in the same vicinity as each other. 

Other variations and modifications which will be apparent to those skilled in the art 
include embodiments of the invention which enable switching at a certain switching 

1 5 level, for example, the finest switching level, to be bypassed and for traffic to 
proceed to the next, coarser granularity switching level. Also, traffic in a high 
capacity fine grain switch which has at least three levels of switching granularity may 
be routed along a combination of a secondary connection(s) and along primary 
connection(s). The route implemented may be determined by the local traffic 

20 conditions at each switch node. In such embodiments, establishing a switch path 
connection may be construed as establishing a path which includes routing traffic 
along a secondary connection as well as along a primary connection, or only along a 
primary connection, as appropriate and as would be apparent to a person skilled in 
the art. 
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